فصلنامه مطالعات اندازه گیری و ارزشیابی آموزشی
پیاپی 29 (بهار 1399)

Regarding the evolution of training evaluation, this paper seeks to examine the new concept of return on expectations in the field of training with quality approach and documentary research method. The method for data analysis was thematic analysis. Searching in scientific databases include Irandoc, Magiran, Sivilica, Elsevier, Emerald, Google Scholar, Amazon, Science Direct, IEEE, Springer, SAGE, obtained 92 documents and sources, that 19 of them were selected in the process of reviewing and selecting documents. The triangulation method was used to increase the validity and reliability coefficient calculated using the Holsti method was 85.9. The process of coding was carried out by MAXQDA software. In this process, 632 codes were obtained that were categorized in the form of 55 basic themes, 11 organizing themes and one global theme. In the end, the thematic network of return on expectations in training evaluation was provided, and based on the relationship between the organizing themes in the literature and through semi-structured interviews with 5 training evaluation experts the return on expectations training evaluating model (ROE) was designed. The components of this process model include: attributes, requirements, identifying stakeholders, determining the expectations, indexing, designing the training, delivering training, evaluating, supporting actions, monitoring, feedback, and consequences. This model can show and increase the effectiveness of training programs based on indicators derived from stakeholder expectations.

The present study was conducted to investigate the involvement or non-involvement influence of university entrance preparatory courses on the academic attitude and achievement motivation of students in Maku. The research method was causal-comparative. The statistical population of the study included all female high school students (N=1000) in the academic year 2017-18. The sample size included 200 students who were chosen through simple random sampling and multi-stage cluster sampling according to the involvement or non-involvement in the university entrance preparatory courses. Data were collected using the McCoach & Sigel`s standard questionnaire for the attitude toward school (SAAS-R) and the Hermann`s standard questionnaire for Achievement Motivation (T.M.A) (1977). Data analysis was carried out through descriptive statistics, multivariate analysis of variance, and independent t-test using SPSS24 software. The results revealed that the academic attitude of those students who participated in the university entrance preparatory courses were significantly more than that of those who had no history of attending those afro-mentioned courses. Also, the achievement motivation of these students was significantly more than those who did not attend the above-mentioned courses.

Measuring of English Language proficiency in large-scale assessments normally requires a large number of test items and relies on paper-and-pencil (P&P) formats; because many people participate annually in this high stake type of tests. The purpose of this research is to design and apply a Computerized Adaptive Testing (CAT) as an alternative to assessing the English language proficiency in the National Organization of Educational Testing. Unlike the traditional P & P tests in which the sequence of selection of items in it is constant and uniform, CAT uses an optimal and adaptive item selection method. CAT caters to optimally estimating temporary ability parameter and achieves a suitable convergence criterion for estimating ability, which results in a shorter, more reliable, and more efficient measurement process. In current study, the case study for examination of English language skill was the TOLIMO test. This research has been carried out in two phases. In the first stage, a sample of pencil-paper TOLIMO (period 114 to 123) was selected and then the items and subjects' ability were calibrated. In the second phase, simulated optimal CATs were designed as a basis for evaluating the efficiency of operational CAT. The results show that the ability parameter estimation method, the maximum likelihood and the fixed length of test as test termination criterion, give the most accuracy in the ability parameter estimation. Also, the simulated CAT TOLIMO test based on the optimum item pool needs less items than the designed CAT based on the available item pool, while it leads to obtain more accurate results in comparison to the operational CAT for ability parameter estimation. Therefore, despite the suitability of the items in the graded item pool of TOLIMO, the design of items to implement the examination with CAT method is so much better and more accurately, the ability parameter is estimated. The study also demonstrates that TOLIMO test in the form of simulated CAT and operational CAT can be more efficient and precise in the evaluation criteria than TOLIMO test in the form of P&P. The findings suggest that CAT has a great potential in efficiently and precisely measuring TOLIMO ability of English language.

The purpose of this study was to assess the socio-cultural and political effects of the continuation of native selection from the perspective of higher education administrators and experts, including experts from the headquarters of higher education, university assistants and educational and student-cultural departments, including universities affiliated to the Ministry of Science and Ministry of Health and Medical Education. This research is a survey research and its statistical community includes experts in educational affairs that 79 of them were selected through purposeful sampling and were evaluated using a questionnaire. Validity of the questionnaire by content method (CVR) and its reliability was assessed by Cronbach's alpha test. To analyze the data, quantitative data analysis software (SPSS) and variance analysis and mean difference between two groups have been used. In this regard, the findings of this research in the descriptive dimension showed that among the total number of respondents (79), about 34% agree with the policy of indigenization, and 66% oppose this policy or method. Respondents who worked in the Ministry of Science, responsible or expert positions, did not agree with non-nominal policies. Also, 43% of the respondents at the universities of the Ministry of Science are opposed to the natively selection of students and 59% of the faculty members of the medical universities agree native selection of students. In order to ensure the realities of these ratios, a chi-square test was conducted between the two variables of native selection of students and organizational affiliation, which confirmed the value of this test (43.13) at 95% confidence level. The most important suggestions of this research are: The importance of diversifying the tribes and multicultural campuses of the universities, the exclusion of indigenous peoples from the provincial, regional and polar states and the application of indigenous choices and fairer distribution of deprived areas.

The purpose of this research was to identify and explain the factors affecting the professional development of faculty members with emphasis on the role of educational departments. The research method is mixed (qualitative-quantitative) research. The statistical population in the qualitative section is the articles related to the professional development of faculty members out of which 42 articles were selected as sample; the data collection tool is the checklist in the qualitative section. In the quantitative part of the statistical population, the heads of educational departments and faculty members of Shahid Bahonar University of Kerman (N = 667) and the sample was proportional to the number of 244 persons. In the qualitative section, 14 factors influencing the professional development of faculty members were identified, whose importance was acknowledged by faculty members and heads of departments in the quantitative section. These components were categorized into two categories of supportive and process management factors. Component ratings with Friedman test (Friedman statistic = 11.58 and p <0.05) showed that faculty members' participation in decision making, management support and research skills were highest. Based on the results obtained, it seems that attention to the components identified as a prerequisite for faculty development programs as a cohesive set provides the necessary context for their development in educational departments, which is the beginning of change in higher education system, respectively.

Cognitive Diagnostic Assessment is a type of educational assessment that serves to identification and diagnosis of the learning disabilities through the application of psychometric models. Presence of numerous models, makes it crucial choose an appropriate Cognitive Diagnostic Model for data analysis. The purpose of this study was to determine a fitting model for reading comprehension tests. The examined data in this study were included responses from 3,000 participants in the Graduate Entrance Exam for English language field, which were selected randomly out of 16044 people. After Creation of matrix Q, two general models (G-DINA and LCDM), two compensatory models (ACDM and DINO) and two non-compensatory models (RRUM and DINA) were considered for comparison. In terms of Chi-squared maximum Fit Index, none of the models were fitted; but in contrast the results of SRMSR index showed that the fit of all data were acceptable with the data. A comparison of Relative Fit Indices cleared that G-DINA and ACDM models have a stronger fit and DINO and DINA have a poorer fit in comparison to the other models. Also, investigating the Question Fit index showed that only G-DINA and LCDM have a fit with all questions.

The study was aimed at identifying parent involvement (PI) barriers in qualitative evaluation (QE) and applied phenomenological qualitative research. For this purpose, semi- structured interview with 35 parents of 6th grade students was conducted, and sample was selected by extreme (opposition) and intensify (proponents) sampling methods. Data analysis revealed 89 base, 15 organizers and 6 comprehensive themes, which are the lake of parental awareness of the basics and characteristics of qualitative evaluation (QE), improper understanding of teachers from parents’ participation in qualitative evaluation (QE), lack of parents’ knowledge from their responsibility, governing quantitative evaluation methods and structure on formal and informal education system, parents’ experiences from education system and socio- cultural factors. According to the findings, suggestions are presented for future researches and Practical solutions.